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This  report  is  based  on  a detailed  analysis  of  the 
Information  Processing  System  Simulator  (IPSS) , DIMUI,  and 
the  Extendable  Computer  System  Simulator  (ECSS) . The 
results  address  the  specific  problem  of  evaluating  the 
capabilities  of  the  above  for  the  modeling  and  performance 
evaluation  of  data  base  management  systems  and  their  com- 
puter system  environments.  Questions  related  to  the 
subject  of  this  report  or  to  the  possibility  of  extending 
the  stated  conclusions  should  be  addressed  to  its  author  at 
the  Federal  Computer  Performance  Evaluation  and  Simulation 
Center  (FEDSIM) . 
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ABSTRACT 


This  report  presents  the  results  of  FEDSIM's  evaluation 
of  the  Information  Processing  System  Simulator  (IPSS) , the 
Extendable  Computer  System  Simulator  (ECSS) , and  DIMUI — 

A Performance  Evaluation  System  for  Data  Base  Management 
with  respect  to  their  data  base  management  system/computer 
system  modeling  capabilities,  modeling  support  facilities, 
and  program  product  qualities. 
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I.  INTRODUCTION 


This  report  presents  the  results  of  FEDSIM's  evaluation 
of  the  Information  Processing  System  Simulator  (^PSS) , ' 
the  Extendable  Computer  System  Simulator  (ECSS) , and 
DIMUI^-^  Performance  Evaluation  System  for  Data  Base  Manage- 
ment. ' The  objective  of  the  evaluation  is  to  assess  the 
Data  Base  System  (DBS)”  modeling  capabilities,  modeling 
support  facilities,  and  program  product  qualities  of  each 
simulator. 


T.  G.  DeLutis,  "A  Methodology  for  the  Performance  Evalua- 
tion of  Information  Processing  Systems,"  Final  Report  to  the 
National  Science  Foundation,  Office  of  Science  Information 
Services,  Grant  No.  GN  36622. 
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T.  G.  DeLutis,  "Information  Processing  System  Simulator 
(IPSS) : Syntax  and  Semantics,"  working  document  to  NSF  Grant 
No.  GN  36622. 

^D.  W.  Kosy,  The  ECSS  II  LANGUAGE  for  Simulating  Computer 
Systems  (The  Rand  Corporation,  1975) . 

4 

A.  Reiter  and  B.  Finkel,  "Simulating  a Virtual  Data 
Machine,"  NTIS  Docximent  No.  AD-A027  894,  May  1976. 

^A.  Reiter,  "DIMUI  - IDMS  User  Manual,  Version  1.2," 
Technical  Report  No.  101,  Israel  Institute  of  Technology, 

June  1977. 

®"Data  Base  System"  is  used  here  to  mean  data  base  manage- 
ment system  and  its  computer  system  environment. 
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II.  METHODOLOGY 


In  order  to  establish  a perspective  from  which  to  view 
and  evaluate  a DBS  simulator,  a structured  set  of  evaluation 
criteria  was  developed.  An  evaluation  technique  was  then 
developed  to  provide  a means  to  specify  the  degree  to  which 
a simulator's  facilities  and  qualities  satisfy  the  criteria, 
and  to  facilitate  a comparative  evaluation  of  IPSS,  DIMUI, 
and  ECSS.  ^ 

A.  EVALUATION  CRITERIA 


The  DBS  simulator  evaluation  criteria  are  organized  into 
three  major  categories:  (1)  modeling  capabilities,  (2) 
modeling  support  facilities,  and  (3)  program  product  qualities. 

1.  Modeling  Capabilities 

DBS  simulation  imposes  a need  for  modeling  capabilities 
oriented  specifically  toward  DBMS's  and  computer  systems,  in 
addition  to  those  capabilities  required  for  simulation  in 
general.  DBS  simulator's  modeling  facilities  can  be  evaluated 
by  the  extent  that  the  simulator  supports  the  modeling  of  the 
items  listed  in  Table  II-l. 

2.  Modeling  Support  Facilities 

The  overall  utility  of  a DBS  simulator  is  determined  by 
its  support  of  the  entire  simulation  modeling  process,  as 
well  as  by  the  actual  modeling  facilities  it  provides.  The 
support  capabilities  specified  in  Table  II-2,  which  benefit 
all  stages  of  the  DBS  simulation  modeling  process,  are  used 
to  evaluate  each  DBS  simulator's  modeling  support  facilities. 

3.  Program  Product  Qualities 

Aside  from  the  functional  and  technical  issues  associated 
with  DBS  simulation  modeling,  a DBS  simulator  should  also  be 
evaluated  as  a program  product.  Table  II-3  identifies  the 
criteria  used  to  evaluate  the  DBS  simulator  as  program 
product. 

B.  EVALUATION  TECHNIQUE 

The  foregoing  categories  of  evaluation  criteria  establish 
the  perspectives  from  which  a DBS  simulator  is  viewed  and 
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° DATA  EASE  MANAGEMENT  SYSTEM  (DBMS) 

- DBMS  buffers 

- Description 

- Management  algorithms 

- Management 

- Management/use  operations 

- Buffer-data  base  access  interaction 

- Utilization  statistics  collection 

- Queueing  statistics  collection 

- Data  base  access  control  mechanisms 

- Data  base  access  scheduling  algorithms 

- Data  base  access  management 

- Request  scheduling  algorithms 

- Data  base  management  utility  functions 

- DBMS  overhead 

- Request  processing  statistics  collection 

- Request  queueing  statistics  collection 

- Data  base  access  statistics  collection 

- Data  base  access  locality  statistics  collection 

- Data  base  access  queueing  statistics  collection 

- DBMS  overhead  statistics  collection 

- Data  manipulation  language  (DML)  operation 
statistics  collection 


MODELING  CAPABILITIES:  EVALUATION  CRITERIA 


TABLE  II-l 


® OPERATING  SYSTEM 

- Resource  management  strategies 

- Resource  management 

- Separation  from  application  program  behavior 

- Supervisory  overhead 

- Supervisory  overhead  statistics  collection 

o TELEPROCESSING  RESOURCES 

- Transmission  control  units 

- Communications  lines 

- Terminal  I/O  devices 

- Terminal  control  units 

- TP  device  connectivity 

- Message  transmission  operations 

- Computation  of  message  transmission  time 

- Message  management  strategies 

- Message  management 

- Line  control 


MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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® PROCESSOR  RESOURCES 

- Definition 

- Execution  rate 

- Execution  rate  degradation  due  to  primary 
memory  contention 

- Different  execution  rates  for  different 
instruction  types 

- Multiprocessor  configurations 

- Processor  management  strategies 

- Processor  management 

- Priority-based  interrupts 

- Execution  bursts 

- Virtual  memory  reference  patterns  associated 
with  execution  bursts 

- Multiprocessor  management  strategies 

- Multiprocessor  management 

- Processes  which  implicitly  require  allocation 
of  a processor 

- Utilization  statistics  collection 

- Queueing  statistics  collection 

- Utilization-by-process  statistics  collection 


MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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® STORAGE  RESOURCES:  PRIMARY  MEMORY 

- Definition 

- Memory  management  strategies 

- Memory  management 

- Allocation/deallocation  requests 

- Capacity  utilization  statistics  collection 

- Capacity  queueing  statistics  collection 

^ STORAGE  RESOURCES;  VIRTUAL  MEMORY 

- Definition 

- Mapping  to  secondary  storage 

- Mapping  to  primary  memory 

- Page  reference 

- Page  transfer 

- Management  strategies 

- Management 

- Page  fault  statistics  collection 

- Utilization  statistics  collection 

- Queueing  statistics  collection 


MODELING  CAPABILITIES;  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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STORAGE  RESOURCES:  SECONDARY  STORAGE,  DIRECT  ACCESS 


- Definition 

- Capacity 

- Physical  organization 

- Space  overhead 

- Space  management  strategies 

- Space  management 

- Space  allocation/deallocation  requests 

- Space  utilization  statistics  collection 

- Space  queueing  statistics  collection 

° STORAGE  RESOURCES:  SECONDARY  STORAGE,  TAPE 

- Definition 

- Capacity 

- Space  overhead 


MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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* I/O  RESOURCES:  DIRECT-ACCESS  STORAGE  DEVICES 

- Definition 

- Transfer  rate 

- Latency 

- Cylinder  access  time 

- Computation  of  cylinder  access  time 

- Computation  of  data  transfer  time 

- Read/write  operations 

- Seek  operation 

- Search  operation 

- Computation  of  search  time 

- Seek  statistics  collection 

- Read/write  statistics  collection 

- Search  statistics  collection 

- Utilization  statistics  collection 

- Queueing  statistics  collection 


MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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° I/O  RESOURCES:  TAPE  DEVICES 

- Definition 

1 

- Transfer  rate 

- Rewind  rate  | 

i 

- Latency  i 

- Computation  of  data  transfer  time  | 

■1 

I 

- Computation  of  rewind  time 

- Read/write  operations 

- Rewind  operation 

- Utilization  statistics  collection 

- Queueing  statistics  collection 

- Read/write  statistics  collection 

- Rewind  statistics  collection 

^ I/O  RESOURCES:  UNIT  RECORD  DEVICES 

- Definition 

- Transfer  rate 

- Latency 

- Computation  of  data  transfer  time 

- Read/write  operations 

- Utilization  statistics  collection 

- Queueing  statistics  collection 

MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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" I/O  RESOURCES:  CONTROL  UNITS 

- Definition 

- Transfer  rate 

- Message  capacity 

- Utilization  statistics  collection 

- Queueing  statistics  collection 

® I/O  RESOURCES:  CHANNELS 

- Definition 

- Transfer  rate 

- Message  capacity 

- Utilization  statistics  collection 

- Queueing  statistics  collection 

“ I/O  RESOURCES:  OTHER  I/O  DEVICES 

- Definition 

- Transfer  rate 

- Computation  of  data  transfer  time 

- Read/write  operations 

- Utilization  statistics  collection 

- Queueing  statistics  collection 

- Read/write  statistics  collection 


MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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® I/O  RESOURCES:  DEVICE  CONNECTIVITY 

- Definition 

- Dynamic  path  selection 

- Path  management  strategies 

- Path  allocation/deallocation 

- Path  management 

- Computation  of  effective  path  data  transfer  rate 
based  on  current  states  of  all  I/O  devices  on  a 
path 

- Critical  device  statistics  collection 

- Path  utilization  statistics  collection 

- Path  queueing  statistics  collection 

* I/O  RESOURCES:  BUFFERS 

- Definition 

- Management  strategies 

- Buffer  management 

- Buffer  allocation/deallocation  requests 

- Buffer-I/0  interaction 

I 

- Utilization  statistics  collection 

- Queuing  statistics  collection 


MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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DATA  RESOURCES;  FILES/FILE  STRUCTURES 


- Definition 

- Record  characteristics 

- Space  allocations 

- Access  methods 

- Record-to-space  allocation  mappings 

- Space  allocation-to-physical  storage  media 
mappings 

- Translation  of  file  access  into  I/O  activity 

- File  access  requests 

- Dynamic  file  creation/deletion 

- Dynamic  file  space  allocation 

- File  management  strategies 

- File  management 

- Access  statistics  collection 

- Queueing  statistics  collection 

- Utilization  statistics  collection 

MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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° DATA  RESOURCES:  DATA  BASE 

- Data  structure  (DS)  representation 

- Multiple  DS ' s 

- DS-to-DS  mappings 

- DS  access/traversal  operations 

- Translation  of  access/traversal  operations  into 
processing  time  and  physical  I/O  activity 

- DS-to-secondary  storage  media  mapping 

- DS-to-virtual  storage  mapping 

- DS-to-file  (structure)  mapping 

- DML  command  characterization 

- DML  command  invocation 

- DS  access  paths 

- Dynamic  access  path  selection 

- Access  path  statistics  collection 

- Data  structure  accessing  statistics  collection 

“ SOFTWARE  RESOURCES 

- Definition 

- Management  strategies 

- Management 

- Allocation/deallocation  requests 

- Utilization  statistics  collection 

- Queueing  statistics  collection 


MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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“ PROCESSES 

- Definition/characterization 

- Implicit  processor  requirement 

- Time  delays 

- Initiation 

- Termination 

- Synchronization/communication/suspension 

- Wait  for  sub-process 

- Wait/post  mechanism 

- Wait  for  I/O 

- Inter-process  message  passing 

- Initialization,  saving,  and  restoring  of  local 
process  variables 

- Process  lists 

- Process  list  entry  discipline 

- Process  list  operations 

- Occurrence  statistics  collection 

- Processor  utilization  statistics  collection 

- Processor  queueing  statistics  collection 

- Resource  utilization  statistics  collection 

- Resource  queueing  statistics  collection 

- I/O  statistics  collection 


MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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WORKLOAD 


- Workload  element  representation 

- Workload  element  arrival  pattern  specification 

- Workload  element  processing  statistics  collection 


° GENERAL-PURPOSE  SIMULACRA 

- Events 

- Definition 

- Internal  events 

- External  events 

- Recurring  events 

- Event  scheduling  operations 

- List  data  structures 

- Definition 

- Dynamic  creation 

- List  elements 

- Definition 

- Data  aggregates 

- Dynamic  creation/deletion 

- List  processing  operations 

- Random  number  generator 

- Probability  distribution  functions 

- Empirical  distributions 

- Event  and  clock  management 

- Recursive  routines 

- Basic  computational  facilities 


MODELING  CAPABILITIES:  EVALUATION  CRITERIA 
TABLE  II-l  (Cont'd) 
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STATISTICS  COLLECTION  CONTROL 


- Suppression/resumption 

- Selective  suppression 

- Selective  omission 

- Reset 

- Cumulative  collection 

- Collection  of  statistics  for  specified  time 
intervals 

“ STATISTICS  REPORTING 

- Automatic  generation  of  reports  in  pre-defined 
formats 

- Selective  report  generation 

- Report  generation  scheduling 

- End -of -simulation 

- Periodically 

- Via  external  events 


® SUPPLEMENTAL  STATISTICS  COLLECTION  AND  REPORTING 

" MODEL  BEHAVIOR  TRACING 

- Statement-execution  level  trace 

- Change-of-state  level  trace 

- Tracing  control 

- Selective  change-of-state  tracing 

- Limited-range  statement-execution  tracing 

- Event-based  scheduling  of  tracing  activity 


MODELING  SUPPORT  FACILITIES:  EVALUATION  CRITERIA 

TABLE  I I -2 
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POST  SIMULATION  PROCESSING 


- Selective  saving  of  raw  statistics  data 

- Graphical  display  of  statistics  data 

- Generation  of  standard  statistics  reports  from 
raw  statistics  data 

” MODEL  SYNTHESIS 

- Model  source  component  library  facilities 

- On-line  interactive  prompting/help  facility  for 
model  source  input 

- On-line  model  source  editing 

- Macro  processing 

° MODEL  VERIFICATION  AND  VALIDATION 

- Run-time  diagnostic  facilities 

- Model  debugging  facilities 

- Tracing 

- Formatted  dumps 

- Behavior  statistics 

- Routine  traceback 

- Snapshot 

- Diagnostics  at  model  source  statement  level 
as  well  as  at  base  language  level 

- On-line,  interactive  debugging  facilities 

- Supplemental  debugging  facilities 


MODELING  SUPPORT  FACILITIES:  EVALUATION  CRITERIA 
TABLE  II-2  (Cont'd) 
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“ MODEL  INITIALIZATION  AND  MODIFICATION 

- Pre-simulation  input  of  model  initialization  data 

- System-defined  capability  for  parameter 
value  entry 

- Modeler-programmable  parameter  value  entry 
and  storaae 

- Modification  with  minimal  or  no  model  source 
reprocessing 

- Assigning  new  values  to  model  parameters 

- Hardware  reconfiguration 

- Routine  replacement 


“ MODEL  PROCESSING 

- Model  source  syntax  checking 

- Library  facilities  for  the  storage  and  retrieval 
of  object/load  modules 

- Diagnostics  at  each  step  of  model  processing 

- Conditional  termination  of  model  processing  at 
any  step  due  to  error (s)  in  a previous  step 

- Operating  system-independent  control  language  to 
initiate  and  control  model  processing 

- Inclusion  of  previously-processed  model  components 


MODELING  SUPPORT  FACILITIES:  EVALUATION  CRITERIA 
TABLE  I 1-2  (Cont'd) 
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MODEL  EXECUTION 


- Run-tirae  diagnostic  facilities 

- Checkpoint/restart 

- Simulation  termination  control 

- Simulated-time  based 

- Event-occurrence  based 

- Error-occurrence  based 

- Run-time  based 

- Operating  system  independent  language  to  initiate 
and  control  model  execution 

- Run-time  monitor  providing  on-line  interaction 
with  a model  during  execution 

- Multiple  simulations  during  a single  run 


° MODEL  OPTIMIZATION 

- Main  storage  space  requirements 

1 

- Program  overlay  - 

- Deletion  of  unneeded  data  structures 

- Release  of  initialization  and  other  routines 
not  required  after  start  of  simulation 

- Omission  of  unneeded  statistics  collection 

- Executional  efficiency 

- Optimizing  compiler 

- Suppression/omission  of  collection  of  unneeded 
statistics 


MODELING  SUPPORT  FACILITIES:  EVALUATION  CRITERIA 
TABLE  II-2  (Cont'd) 
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“ ACQUISITION  COSTS 

- Simulator 

- Other  software  products 

" MAINTENANCE 

- Costs 

- Probability  of  continuing,  long-term  support 

° RESOURCE  REQUIREMENTS 

- Specific  computer  systems  and/or  operating 
systems 

- Main  memory  space 

- Language  compiler (s),  assemblers 

- Other  software  products 

^ PORTABILITY 

® STABILITY/RELIABILITY 

PROGRAM  PRODUCT  QUALITIES:  EVALUATION  CRITERIA 

TABLE  I I- 3 
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DOCUMENTATION 


- User's  manual 

- Language  reference  manual 

- Program  logic  manual 

- Texts,  tutorials 

- Descriptions  of : 

- Default  algorithms 

- System-defined  data  structures 

- Random  number  generator  algorithms 

- Probability  distribution  function  algorithms 

- Timing  routine 

- Event  management 

- Process  management 

- System-defined  subprogram  communication 
conventions 


° TRAINING 

- Courses 

- Consultation 


PROGRAM  PRODUCT  QUALITIES:  EVALUATION  CRITERIA 


TABLE  II-3  (Cont'd) 


evaluated.  Depending  on  the  category,  an  evaluation  technique 
ranging  from  qualitative  assessment  to  quasi-quantitative 
measurement  is  used,  as  described  below. 


1.  Modeling  Facilities 

Depending  on  the  richness  of  a language's  modeling  con- 
structs and  features,  a desired  capability  may  be  achievable 
with  or  without  there  being  an  explicit  feature  for  it. 

Thus,  it  is  not  sufficient  to  simply  state  that  a simulator 
"has"  a particular  capability  or  does  not  have  it.  To 
objectively  evaluate  a simulator's  true  modeling  capabilities, 
a more  quantitative  measurement  scale  is  needed.  Such  a 
measurement  scale  will  also  facilitate  the  comparison  of 
languages  with  both  similar  and  diverse  features  for  satisfying 
the  same  set  of  requirements. 

To  achieve  a desired  modeling  capability,  a certain 
cimount  of  modeling  effort  is  required  on  the  part  of  a 
modeler;  and  the  aimount  of  effort  will  vary  depending  on  the 
features  of  the  simulator  being  used.  The  degree  to  which  a 
simulator  supports  a desired  modeling  capability  can  be 
"measured"  in  terms  of  the  level  of  modeling  effort  required 
to  achieve  the  capability  using  the  simulator's  modeling 
facilities.  Thus,  the  quasi-quantitative  measurement  scale 
to  be  used  for  evaluating  a DBS  simulator's  modeling  capabili- 
ties will  have  level  of  modeling  effort  as  a metric. 

Specifically,  the  evaluation  technique  will,  for  each 
modeling  capability,  specify  the  following: 

a.  Whether  or  not  the  capability  is  explicitly  provided 
(a  measure  of  the  richness  of  a simulator's  modeling 
constructs) . 


b.  The  level  of  modeling  effort  required,  encoded  as 
one  of  the  following: 


" NONE : 

® DCL: 

" STMT : 


Capability  is  provided  automatically/ 
implicitly 

Capability  is  achieved  via  a declarative 

Capability  is  achieved  via  one  or  very 
few  in-line  (high-level)  statement (s) 
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° ROUTINE:  Capability  is  achieved  via  a single 

(process)  routine  or  a relatively 
small  number  of  in-line  statements 


° MODULE:  Capability  is  achieved  via  two  or  more 

routines  and/or  many  in-line  low-level 
statements 

° MODULE+:  Capability  is  achieved  via  two  or  more 

routines  and/or  many  in-line  low-level 
statements,  plus  new  data  structure (s) 


° MODULE++:  Capability  is  achieved  via  two  or  more 
routines  and/or  many  in-line  low-level 
statements,  plus  new  data  structure (s) 
and  substantial  modifications  to 
system-defined  data  structures  and/or 
system  routines 


c.  Qualifying  remarks  regarding  how  the  capability  is 
achieved,  limitations,  etc. 


2 . Modeling  Support  Facilities 

The  modeling  support  facilities  of  a simulator  are 
appraised  using  a qualitative  assessment  technique.  For 
each  support  requirement,  the  following  is  specified: 

a.  An  indication  (YES  or  NO)  of  the  availability  of  the 
modeling  support  facility. 

b.  If  the  support  facility  is  provided,  an  appraisal  of 
its  comprehensiveness  and/or  limitations,  if  appropriate. 


3 . Program  Product  Qualities 

A qualitative  assessment  is  made  of  the  qualities  of 
each  simulator  as  a program  product  per  the  specified  evalu- 
ation criteria. 
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III.  ASSUMPTIONS  AND  CONSTRAINTS 


The  results  of  the  evaluation  are  based  on  (1)  a review 
of  all  available  documentation  on  IPSS,  DIMUI,  and  ECSS; 

(2)  FEDSIM's  experiences  with  ECSS  and  IPSS;  and  (3)  limited 
discussions  with  the  developers  of  IPSS  and  DIMUI. 

Additional  insight  into  the  capabilities  and  usability 
of  each  simulator  for  DBS  modeling  could  be  obtained  by 
benchmark  studies,  involving  the  application  of  each  simulator 
to  a set  of  representative  DBS  modeling  problems.  Such  studies 
are,  however,  beyond  the  scope  of  this  project. 

The  developmental  nature  of  IPSS  and  DIMUI  is  recognized 
and  every  effort  has  been  made  to  represent  as  accurately  as 
possible  the  capabilities  of  each.  Capabilities  which  are 
inadequately  documented  or  undocumented  raay  not  be  accurately 
represented. 
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IV. 


FINDINGS  AND  RESULTS 


A.  IPSS 

The  results  of  the  evaluation  of  IPSS  with  respect  to 
its  modeling  capabilities,  modeling  support  facilities,  and 
program  product  qualities  are  presented  below.  Detailed 
evaluation  results  are  presented  in  tabular  format  in 
Appendix  A. 

1 . Modeling  Capabilities 

IPSS  modeling  constructs  are  embodied  in  a modeling 
language  comprised  of  a large  number  of  declarative  and 
executable  statements.  Due  to  the  large  number  of  statement 
types  and  the  often  large  number  of  parameters  per  state- 
ment, the  IPSS  language  is  not  an  easy  language  to  learn. 
Learning  the  language  is,  however,  facilitated  by  the 
natural  way  in  which  many  of  the  statements  correspond  to 
components  and  operations  within  the  DBS  being  modeled. 

DBMS  Modeling.  IPSS  provides  facilities  for  modeling 
DBMS-related  application  programs,  DBMS  software,  and  DBMS 
buffer  management.  Built-in  features  facilitate  character- 
izing data  manipulation  operations,  modeling  data  structure 
traversal,  and  simulating  data  base  access.  All  DBMS 
application  programs,  scheduling  algorithms,  utility  functions, 
data  manipulation  operations,  and  other  software  strategies 
must  be  procedurally  characterized.  There  is  no  implicit 
mechanism  for  modeling  data  base  access  management  or  DBMS 
request  management.  Statistics  on  data  base  accessing,  DBMS 
request  processing,  and  DBMS  software  execution  are  auto- 
matically collected  and  reported. 

Operating  System  Modeling.  IPSS  does  not  represent  the 
supervisory  software  of  a computer  system  as  a distinct  model 
component.  Resource  management  functions  must  be  procedur- 
ally characterized.  Supervisory  overhead  is  not  represented 
explicitly  and  is  not  reported  as  a separate  component  of 
resource  utilization.  IPSS  does  provide  certain  capabilities 
which  will  facilitate  the  characterization  of  resource  manage- 
ment strategies,  including  the  automatic  association  of  a 
queue  with  each  defined  resource,  queues  and  queue  management, 
and  process  suspension  and  synchronization. 

Teleprocessing  Subsystem  Modeling.  IPSS  does  not  provide 
explicit  facilities  for  modeling  teleprocessing  (TP) 
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environments.  Certain  IPSS  definitional  facilities  can  be 
adapted  to  describe  TP  hardware  configurations  and  charac- 
terize TP  message  transmission;  but  extensive  supplemental 
coding  is  required  for  modeling  line  control,  message 
management , etc . 

Processor  Resource  Modeling.  Other  than  the  capabilities 
to  define  a CENTRAL  PROCESSOR  or  an  INPUT  OUTPUT  PROCESSOR 
facility  and  to  represent  time  delays  within  processes,  IPSS 
provides  no  special  support  for  simulating  processors, 
interrupts,  processor  management,  and  processor  usage. 

Storage  Resource  Modeling.  Primary  memory  is  represented 
explicitly  and  may  be  characterized  either  as  simply  having 
a capacity  or  as  consisting  of  some  number  of  partitions, 
each  of  which  has  a capacity.  Procedural  operations  for 
effecting  memory  allocation/deallocation  are  provided.  No 
implicit  memory  management  capability  is  provided.  Memory 
utilization  statistics  are  collected  automatically  in 
response  to  memory  allocation/deallocation  operations. 

IPSS  provides  no  explicit  facilities  for  the  represen- 
tation of  virtual  memory,  virtual  memory  management,  or 
virtual  memory  usage. 

Facilities  are  provided  for  the  description  of  secondary 
storage  devices,  including  direct-access  and  tape  devices, 
and  for  the  representation  of  secondary  storage  for  space 
management  purposes.  No  implicit  secondary  storage  space 
management  capability  is  provided. 

I/O  Resource  Modeling . IPSS  provides  explicit  capabilities 
for  the  description  of  secondary  storage  I/O  devices,  control 
units,  channels,  and  other  peripheral  I/O  devices,  and  the 
representation  of  I/O  device  configurations.  I/O  statistics 
are  collected  automatically  for  all  I/O  devices. 

IPSS  allows  the  description  of  buffer  pools  and  provides 
built-in  buffer  allocation/deallocation  operations.  Buffer 
utilization  statistics  are  collected  automatically  in  response 
to  those  operations.  There  is  no  implicit  buffer  management 
capability. 

Data  Resource  Modeling.  IPSS  provides  extensive  facilities 
for  the  description  of  files  and  file  structures,  the  specifi- 
cation of  file  placement,  and  the  representation  of  file 
accessing.  File  references  are  automatically  translated 
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into  physical  storage  addresses.  File  (structure)  access 
methods  must  be  procedurally  characterized.  File  accessing 
statistics  are  collected  automatically. 

Extensive  facilities  are  also  provided  for  describing 
data  base  structure  and  for  characterizing  data  base  access. 
Those  facilities  allow  the  description  of  arbitrary  hier- 
archical and  network  data  structures,  data  structure  imple- 
mentation techniques,  and  data  structure  access  paths. 

IPSS  automatically  collects  and  reports  statistics  on  data 
base  accessing  and  access  path  utilization. 

Software  Resource  Modeling.  Software  strategies  are 
characterized  procedurally,  and  are  implicitly  regarded  as 
resources.  Thus,  they  can  be  allocated  and  released.  A 
process  can  be  automatically  delayed  pending  the  availability 
of  a software  resource.  Queueing  and  utilization  statistics 
are  automatically  collected  for  all  software  resources. 

Process  Modeling.  In  IPSS,  a process  is  called  a "service, 
and  there  are  two  types.  An  "exogenous  service"  represents 
an  external  stimulus  to  the  model  (e.g.,  the  arrival  of  a 
transaction) , whereas  an  "endogenous  service"  represents 
some  unit  of  internal  processing  (e.g.,  the  execution  of  a 
software  resource) . There  are  built-in  operations  for 
process  initiation,  suspension,  synchronization,  communi- 
cation, and  termination.  Process  utilization  and  queueing 
statistics  are  collected  automatically.  Resource  queueing 
and  utilization  statistics  may  be  collected  on  a per  process 
basis. 

In  addition  to  its  special-purpose  DBS-oriented  modeling 
capabilities,  IPSS  provides  a built-in  multiple-seed  random 
number  generation  capability,  built-in  probability  distribution 
functions,  and  list  processing  capabilities.  Basic  program- 
ming capabilities  are  provided  by  IPSS's  FORTRAN  IV  base 
language . 

2 . Modeling  Support  Facilities 

Statistics  Collection  Control.  IPSS  provides  for  the 
automatic  collection  of  many  statistics.  Control  of  statistics 
collection  is  limited  to  the  resetting  of  statistics  between 
consecutive  simulations. 

Statistics  Reporting.  IPSS  produces  statistics  reports 
automatically  at  the  end  of  a simulation.  Aside  from  being 
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able  to  suppress  the  automatic  generation  of  reports,  the 
modeler  has  no  control  over  statistics  reporting. 

Supplemental  Statistics  Collection  And  Reporting.  Addi- 
tional  statistics  collection  and  reporting  can  be  programmed 
by  the  modeler  in  FORTRAN  IV. 

Model  Behavior  Tracing.  Limited  tracing  facilities  are 
provided  by  IPSS . A routine-execution  trace  of  either 
modeler-written  and/or  IPSS  routines  is  supported;  in  addition, 
the  contents  of  all  active  process  and  I/O  transactions  can 
be  displayed. 

Post  Simulation  Processing.  The  modeler  has  the  capability 
to  program  post  simulation  analysis,  which  can  occur  after  a 
simulation  and/or  between  consecutive  simulations.  Analysis 
routines  are  programmed  in  FORTRAN  IV. 

Model  Synthesis.  IPSS  provides  model  source  component 
library  facilities  which  allow  the  modeler  to  store  model 
segments  for  future  reference.  Coupled  with  these  facilities 
is  a simple  macro  facility  for  effecting  textual  substitution 
during  retrieval  of  a stored  model  segment. 

Model  Verification  And  Validation.  IPSS's  error-checking, 
tracing,  and  statistics  collection  and  reporting  facilities 
as  well  as  the  diagnostic  facilities  provided  by  the  FORTRAN  IV 
run-time  system,  assist  in  model  verification/validation. 

Model  Initialization  And  Modification.  Model  pareuneter 
values  may  be  entered  at  the  beginning  of  or  between  simu- 
lations. Such  parameters  can  be  referenced  from  both  declara- 
tive and  procedural  model  components.  Additional  parameter 
value  entry  and  storage  can  be  progreimmed  using  FORTRAN  IV. 

IPSS  allows  a wide  range  of  model  modifications  which 
can  be  made  at  the  beginning  of  a simulation  or  between 
consecutive  simulations. 

Model  Processing.  The  processing  of  an  IPSS  model  involves 
IPSS  language  translation,  FORTRAN  IV  compilation,  and  linkage 
editing.  Model  processing  is  controlled  using  an  operating 
system- independent  control  language,  thereby  minimizing  the 
use  of  operating  system  job  control  language  and  allowing 
for  optimization  of  model  processing  by  batching  translation, 
compilation,  and  linkage  edit  operations. 
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Model  Execution.  IPSS  provides  simulation-time  diagnostic 
facilities.  As  with  model  processing,  model  execution  is 
initiated  and  controlled  using  IPSS  language  directives. 

IPSS  provides  a variety  of  simulation  termination  control 

capabilities.  Multiple  simulations  may  be  performed  during 
a single  IPSS  run. 

Model  Optimization . IPSS  provides  no  specific  facilities 
for  optimizing  a model' s storage  space  requirements  and/or 
executional  efficiency. 

3.  Progretm  Product  Qualities 

IPSS  is  a public  domain  product.  It  currently  exists 
only  as  a prototype  developmental  system.  As  a consequence, 
only  a very  limited  evaluation  of  its  program  product  qualities 
can  be  made.  A substantial  eunount  of  development  work  and 
docvimentation  remains  to  be  done.  IPSS ' s stability  and 
reliability  can  only  be  ascertained  by  subjecting  it  to 
extensive  use.  Its  portability  is  restricted  to  IBM  System 
360/370  due  to  the  need  for  a PL/I  compiler  and  internal 
assembler  routines. 

B.  ECSS 

The  results  of  the  evaluation  of  ECSS  with  respect  to 
its  modeling  capabilities,  modeling  support  facilities,  and 
program  product  qualities  are  summarized  below.  Detailed 
evaluation  results  are  presented  in  Appendix  B< 

1.  Modeling  Capabilities 

ECSS  modeling  constructs  are  embodied  in  a modeling 
language  comprised  of  a relatively  few  number  of  declarative 
and  executable  statement  types.  Since  ECSS  is  a superset  of 
SIMSCRIPT  II. 5,  the  use  of  ECSS  necessitates  a knowledge  of 
SIMSCRIPT  II. 5.  The  ECSS  language  itself  is  relatively  easy 
to  learn  due  to  its  English-like  form  and  the  natural  way  in 
which  its  modeling  constructs  correspond  to  the  components 
and  operations  of  the  DBS  being  modeled.  In  addition,  the 
set  of  ECSS  statement  types  is  easily  extended  through  the 
use  of  ECSS  macro  facilities. 

DBMS  Modeling.  ECSS  provides  no  special  support  for 
simulating  DBMS  components  and  processing  activities.  ECSS 
modeling  facilities,  although  partially  satisfying  DBMS- 
related  modeling  requirements,  must  be  augmented  with  a 
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substantial  amount  of  lower-level  coding  and  new  data 
structures  to  achieve  desired  DBMS  modeling  capabilities. 

Operating  System  Modeling.  ECSS  provides  for  the  repre- 
sentation  of  a computer  system's  supervisory  software  as  a 
distinct  model  component,  def initionally  independent  of 
application  software  characterization.  The  concept  of  a 
"manager"  mediating  between  requests  for  resources  and  the 
allocation  of  those  resources  is  central  to  ECSS.  Whenever 
a request  occurs,  or  a resource  is  released,  a manager  routine 
is  called  to  try  to  satisfy  the  request,  or  to  reallocate 
the  resource  to  a queued  request,  as  necessary.  ECSS  supplies 
default  managers  for  all  definable  resources.  These  managers 
embody  typical  resource  allocation  algorithms  found  in  computer 
systems.  Having  such  managers  allows  the  characterization 
of  supervisory  software  with  minimal  effort.  The  modeler  is, 
however,  not  locked  in  to  the  default  managers.  To  support 
the  construction  of  new  managers,  the  default  managers  are 
available  for  user  modification  and  their  operation  is  fully 
explained.  Supervisor  overhead  can  be  represented  explicitly 
and  independently  of  other  execution  activity . ECSS  auto- 
matically collects  and  reports  statistics  on  supervisor 
overhead. 

Teleprocessing  (TP)  Modeling.  ECSS  provides  limited 
support  for  simulating  TP  resources  and  activities.  Such 
support  primarily  pertains  to  the  description  of  TP  devices 
and  device  connectivity,  and  the  representation  of  message 
transmission.  A substantial  amount  of  supplemental  coding 
is  required  to  achieve  desired  modeling  capabilities  related 
to  line  control,  message  management,  and  TP-related  statistics 
collection. 

Processor  Resource  Modeling.  ECSS  provides  extensive 
facilities  for  simulating  processors.  Specific  facilities 
are  available  for  representing  processors  and  multiprocessors, 
the  memories  in  which  they  execute,  the  jobs  that  use  them, 
and  their  management  strategies.  Processor  management  is  an 
implicit  aspect  or  simulated  job  execution.  Processor 
utilization  and  queueing  statistics  are  automatically  collected 
and  reported  by  ECSS. 

Storage  Resource  Mooeling.  ECSS  provides  facilities  for 
simulating  arbitrary  storage  devices  and  storage  management. 

A storage  device  may  be  represented  as  simply  having  a 
capacity  which  is  incremented  or  decremented  in  response  to 


allocations  and  deallocations.  Alternatively,  it  may  be 
represented  as  an  address  space  which  is  allocated  in  distinct, 
contiguous  pieces.  In  either  case,  default  storage  management 
algorithms  are  provided.  Such  storage  device-related 
simulacra  may  be  applied  to  the  modeling  of  main  memory, 
virtual  memory,  and  secondary  storage.  ECSS  automatically 
collects  and  reports  storage  utilization  and  queueing 
statistics. 

I/O  Resource  Modeling.  ECSS  allows  the  definition  of 
arbitrary  l/O  devices  in  terms  of  their  simultaneous  message 
capacity,  nominal  transfer  rate,  and  maximum  transfer  rate 
for  all  concurrent  messages.  It  also  allows  the  arbitrary 
connection  of  any  number  of  these  devices  to  form  an  I/O 
data  path.  I/O  management  algorithms  are  provided,  and  can 
be  easily  modified  or  replaced.  I/O  management,  including 
dynamic  path  selection,  is  implicitly  performed  for  each 
simulated  I/O  operation.  The  representation  of  buffers, 
buffer  usage,  and  buffer  management,  while  not  explicitly 
supported,  may  be  readily  accomplished  using  the  concept  of 
a storage  device  together  with  its  associated  storage  manage- 
ment facilities  and  allocation/deallocation  requests.  ECSS 
automatically  collects  and  reports  statistics  on  I/O  device 
utilization,  queueing,  and  transmission  rates,  and  I/O  data 
path  queueing  and  utilization. 

Data  Resource  Modeling.  ECSS  does  not  support  file 
(structure)  description,  file  allocation  to  storage  devices, 
or  file  accessing.  It  also  does  not  support  the  representation 
of  data  structures,  data  structure  implementation  techniques, 
and  data  structure  accessing.  A substantial  number  of 
SIMSCRIPT  statements  and  new  data  structures  are  required  to 
achieve  such  capabilities.  The  ECSS  macro  facilities  have 
been  used  to  extend  the  ECSS  language  syntax  with  statements 
that  realize  many  of  the  desired  fiie-related  modeling 
capabilities. 

Software  Resource  Modeling.  ECSS  provides  no  explicit 
representation  of  software  processes  as  resources. 

Process  Modeling.  ECSS  supports  two  types  of  processes: 
"external  processes,"  which  usually  represent  the  dynamics 
of  system  loading  or  the  behavior  of  equipment/users  external 
to  the  system  under  study;  and  "jobs,"  which  represent 
executable  programs  which  implicitly  require  a simulated 
processor  in  order  to  execute.  Extensive  facilities  are 
provided  for  process  initiation,  suspension,  synchronization. 
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termination,  and  interprocess  communication.  ECSS  automatic- 
ally collects  and  reports  statistics  on  process  execution; 
additionally,  process  types  may  be  grouped  into  "families" 
for  which  ECSS  automatically  collects  and  reports  statistics. 

In  addition  to  its  special-purpose  computer  system- 
oriented  modeling  capabilities,  ECSS  also  provides  extensive 
general-purpose  simulacra  and  basic  programming  capabilities 
via  its  SIMSCRIPT  II. 5 base  language. 

2.  Modeling  Support  Facilities 

Statistics  Collection  Control.  ECSS  allows  the  modeler 
to  control  the  automatic  collection  and  reporting  of  statis- 
tics. Control  capabilities  include  the  suppression/omission 
of  selected  statistics,  reset  of  statistics,  and  collection 
of  statistics  for  specified  simulated-time  intervals. 

Statistics  Reporting.  In  addition  to  producing  statistics 
reports  automatically  at  the  end  of  a simulation,  ECSS 
provides  the  modeler  with  run-time  control  of  statistics 
reporting. 

Supplemental  Statistics  Collection  And  Reporting. 

SIMSCRIPT  II. 5 provides  special  facilities  for  automatic 
statistics  data  collection  and  analysis  based  on  modeler- 
specified  directives.  In  addition,  SIMSCRIPT  II. 5 provides 
special  report  generation  features. 

Model  Behavior  Tracing.  ECSS  provides  extensive  tracing 
facilities  ranging  from  high-level  statement  execution 
tracing  to  detailed  model  change-of -state  tracing.  The 
modeler  is  provided  with  run-time  control  over  trace  options 
and  trace  start/stop  times. 

Post-Simulation  Processing.  ECSS  provides  the  capability 
of  selectively  saving  raw  statistics  data  for  post-simulation 
analysis.  Behavior  traces  and  standard  statistics  reports 
can  be  generated  from  the  saved  statistics  data.  Additional 
analysis  can  be  programmed  using  SIMSCRIPT  11.5. 

Model  Synthesis.  A powerful  macro  facility  is  provided 
for  modifying  or  extending  the  basic  ECSS  language  syntax. 
Macros  may  be  recursive,  may  have  arguments,  and  may  contain 
default  values  for  arguments  not  specified  at  macro-call  time. 
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Model  Verification  And  Validation.  The  combination  of  * 

ECSS's  error-checking,  tracing,  statistics  collection  and  | 

reporting,  and  model  snapshot  facilities  and  SIMSCRIPT  II. 5' s | 

error-detection  and  debugging-oriented  features  provides  the 
modeler  with  powerful  capabilities  for  model  verification  and  j 

validation. 

“s.  ! 

Model  Initialization  And  Modification.  Model  parameter 
value  entry  and  storage  can  be  programmed  in  SIMSCRIPT  II. 5. 

Data  elements  in  ECSS-defined  data  structures  are  referenceable  i 

by  name,  permitting  easy  access/modification.  Substitution  of  j 

one  subprogram  for  another  can  be  accomplished  easily  through 
the  use  of  subprogram  variables. 

Model  Processing.  Model  processing  is  a multi-step 
process,  involving  ECSS  translation,  SIMSCRIPT  II. 5 compi- 
lation, and  linkage-editing/loading.  Diagnostic  facilities 
are  provided  at  each  step  in  the  process.  Model  processing 
is  initiated  and  controlled  via  operating  system  job  control 
language  statements. 

Model  Execution.  ECSS  provides  run-time  diagnostic 
facilities.  Generally , an  error  is  considered  fatal,  causing 
the  simulation  to  stop.  ECSS  provides  the  modeler  with  the 
capability  to  terminate  a simulation  at  a specified  simulated- 
time. Simulation  termination  based  on  any  other  criteria  must 
be  modeler-prograirimed . 

Model  Optimization . ECSS/SIMSCRIPT  II. 5 provide  the 
modeler  with  certain  capabilities  for  optimizing  a model's 
main  storage  space  requirements  and/or  executional  efficiency. 

3 . Program  Product  Qualities 

ECSS  is  maintained  by  FEDSIM.  Implementations  of  ECSS 
exist  for  the  following  computer  systems;  IBM  System  360/370 
series,  Honeywell  600/6000  series,  CDC  6000/7000  series,  and 
UNIVAC  1100  series.  Since  the  base  language  of  ECSS  is 
SIMSCRIPT  II. 5,  a SIMSCRIPT  II. 5 compiler  is  required.  ECSS 
is  a stable  program  product  whose  reliability  has  been 
established  by  extensive  use  over  a three-year  period.  ECSS 
courses  and  consultation  are  available  from  FEDSIM. 

1 

C.  DIMUI  j 

i 

The  results  of  the  evaluation  of  DIMUI  with  respect  to  * 

its  modeling  capabilities,  modeling  support  facilities,  and  , 
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program  product  qualities  are  summarized  below.  Detailed 
evaluation  results  are  presented  in  Appendix  C. 

1 . Modeling  Capabilities 

As  it  currently  exists,  DIMUI  is  difficult  to  use  due  to 
the  lack  of  a modeling  language.  DBS  model  synthesis  involves 
the  coding  of  FORTRAN  IV  subprograms  and  the  input  of  model 
parameter  values  in  fixed,  pre-defined  formats. 

DBMS  Modeling.  DIMUI  provides  explicit  facilities  for 
simulating  DBMS  buffer  usage  and  management,  data  structure 
traversal  and  accessing,  data  base  access,  data  base  access 
control  and  scheduling,  and  request  scheduling.  DIMUI 
provides  a framework  which  the  modeler  tailors  to  a specific 
DBMS  via  the  insertion  of  resource  management  strategies  and 
characterizations  of  DML  operations  and  other  DBMS  functions. 

Operating  System  Modeling.  DIMUI  provides  for  the 
representation  of  certain  computer  system  supervisory  software 
functions  as  distinct  model  components,  def initionally 
independent  of  application  software  characterization. 
Specifically,  job  scheduling,  processor  management,  disk  I/O 
scheduling,  channel  scheduling,  buffer  management,  and  disk 
space  management  strategies  can  be  represented.  DIMUI 
supplies  default  modules  for  each  of  the  above  supervisory 
functions.  Resource  management  functions  are  performed 
implicitly  in  response  to  resource  allocation/deallocation 
requests. 

Teleprocessing  (TP)  Modeling.  DIMUI  provides  no  support 
for  modeling  TP  resources  and  activities. 

Processor  Resource  Modeling.  Limited  support  is  provided 
for  simulating  processors.  Specific  facilities  are  provided 
for  representing  processors,  processor  usage,  interrupts, 
and  processor  management  strategies.  Processor  management 
is  an  implicit  aspect  of  simulated  task  execution.  DIMUI 
provides  a default  uni-processor  management  strategy. 

Processor  utilization  statistics  are  automatically  collected 
and  reported. 

Storage  Resource  Modeling.  DIMUI  allows  the  representation 
of  disk  and  tape  secondary  storage  devices.  Facilities  are 
provided  for  representing  disk  space  usage  and  management, 
including  a default  disk  space  manager. 
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Main  memory  is  representable  only  as  a collection  of 
buffers  organized  into  one  or  more  buffer  pools.  Facilities 
are  provided  for  the  representation  of  buffers,  Duffer 
usage,  and  buffer  management. 

I/O  Resource  Modeling.  DIMbl  supports  the  representat; 'jn 
of  certain  l/O  devices,  specifically,  tape  and  disk  units 
and  channels.  A simple  channel-disk/tape  unit  architecture 
is  supported.  I/O  device  management  is  an  implicit  aspect 
of  I/O  device  modeling.  Disk  I/O  requests  are  managed  by  a 
disk  scheduler;  each  channel  is  managed  by  a channel  scheduler. 
DIMUI  supplies  default  disk  and  channel  scheduling  strategies. 

Specific  facilities  are  provided  for  the  representation 
of  buffers,  buffer  usage,  .and  buffer  management.  Buffering 
is  an  implicit  aspect  of  simulated  data  base  access.  A 
variety  of  alternative  buffer  management  strategies  are 
built  into  DIMUI. 

DIMUI  automatically  collects  and  reports  statistics  on 
tape/disk  device  utilization,  channel  utilization,  and  I/O 
requests. 

Data  Resource  Modeling.  DIMUI  supports  file  (structure) 
description,  file  allocation  to  stoirage  devices,  and  simulated 
file  accessing.  In  addition,  it  supports  the  representation 
of  data  structures,  data  structure  implementation  techniques, 
and  data  structure  traversal/accessing.  The  data  structure 
modeling  capability  is  sufficiently  general  to  allow  the 
representation  of  arbitrary  hierarchical  and  network  data 
structures. 

Software  Resource  Modeling.  DIMUI  provides  ..o  explicit 
representation  of  software  processes  as  resources. 

Process  Modeling.  DIMUI  supports  the  representation  of 
processes  as  ''tasks , " which  represent  executable  programs 
consisting  of  a series  of  processing  and  data  structure 
access/traversal  activities. 

In  addition  to  its  special-purpose  DBMS-oriented  modeling 
capabilities,  DIMUI  provides  a built-in  multiple-seed  random 
number  generation  capability,  built-in  probability  distribution 
functions,  and  modeler-defined  distribution  tables.  Basic 
programming  capabilities  are  provided  via  DIMUI ' s FORTRAN  IV 
base  language. 
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Modeling  Support  Facilities 


Statistics  Co^ection  Control.  DIMUI  provides  limited 
automatic  statistics  collection  but  does  not  provide  the 
modeler  with  any  control  over  the  statistics  collection 
process. 

Statistics  Reporting.  Statistics  reports  are  automatic- 
al ly~pfo3uce3~aFtHe~encr  of  a simulation. 

Suppl^ental  Statistics  Collection  And  Reporting.  The 
capabilities  of  FORTRAN  IV  are  available  for  programming 
supplemental  statistics  collection  and  reporting. 

Model  Behavior  Tracing.  DIMUI' s tracing  facilities  are 
limited  to  the  automatic  logging  of  all  events  and  interrupts. 

Post- Simulation  Processing.  Any  post-simulation  analysis 
would  have  to  be  prograiraned  by  the  modeler  in  FORTRAN  IV. 

Model  Synthesis.  No  special  capabilities  are  provided  for 
facilitating  the  model  synthesis  process. 

Model  Verification  And  Validation.  DIMUI 's  error-checking, 
tracing,  and  statistics  collection  and  reporting  facilities 
provide  limited  assistance  for  model  verification/validation. 

Model  Initialisation  jyid  Modification.  DIMUI  provides 
extensive  model  parameterization,  thereby  facilitating  model 
initialization/modification.  Parameterization  applies  to 
selection  of  system-supported  resource  management  strategies, 
selection  of  system- supported  secondary  storage  device 
characteristics,  selection  of  system- supported  DBMS-related 
software  strategies,  workload  description,  data  structure 
characteristics,  and  secondary  storage  hardware  configuration. 
Additional  model  parameter  value  entry  and  storage  can  be 
programmed  in  FORTRAN  IV. 

Model  Processing.  Model  processing  is  a multi-step 
process,  involving  FORTRAN  IV  compilation  and  linkage-editing. 
It  is  initiated  and  controlled  via  operating  system  job  control 
language  statements.  No  special  capabilities  related  to  model 
processing  are  provided. 

Model  Execution.  DIMUI  provides  the  modeler  with  the 
capability  to  terminate  a simulation  either  when  all  events 
and  interrupts  have  been  processed  or  by  an  explicit  command. 
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Model  Optimization.  There  are  no  documented  model  optimiza- 
tion  capabilities. 

3.  Program  Product  Qualities 

DIMUI  is  a public  domain  product.  It  currently  exists 
only  as  a developmental  system.  Consequently,  only  a very 
limited  evaluation  of  its  program  product  qualities  can  be 
made.  Much  additional  documentation  concerning  DIMUI 's  modeling 
capabilities,  internal  operations,  etc.,  is  needed.  DIMUI  is 
portable,  since  it  is  implemented  in  standard  FORTRAN  IV. 
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V.  CONCLUSIONS 


The  following  conclusions  have  been  reached  regarding 
the  basic  DBS  modeling  capabilities  of  IPSS,  ECSS,  and 
DIMUI . 

A.  IPSS 

Extensive  support  is  provided  for  modeling  data  base 
structures,  data  base  accessing,  files,  file  accessing,  and 
secondary  storage  device  I/O  and  space  management.  No 
special  support  is  provided  for  modeling  TP  subsystem  com- 
ponents and  activities.  IPSS  does  not  support  the  represen- 
tation of  computer  system  supervisory  software  as  a distinct 
model  component. 

IPSS  is  most  applicable  to  the  modeling  of  a DBS  from 
the  perspective  of  its  DBIIS  subsystem.  V7ith  its  focus  on 
data  base  structure,  data  base  accessing,  DBMS  workload,  and 
secondary  storage  hardware  and  associated  I/O  activity,  IPSS 
readily  supports  the  examination  of  the  influence  on  DBMS 
behavior  of  a variety  of  factors  such  as  data  structures, 
data  structure  implementations,  data  base  access  strategies, 
DBMS  loading,  secondary  storage  hardware  configurations,  and 
secondary  storage  resource  management  strategies. 

The  data  base,  file,  and  secondary  storage  related 
modeling  capabilities  of  IPSS  represent  a significant  contri- 
bution to  computer  system  simulation  modeling  technology. 
FEDSIM  recommends  continuing  interest  in  and  support  of  the 
use  and  further  development  of  those  capabilities  of  IPSS. 

B.  ECSS 

Extensive  support  is  provided  for  modeling  computer 
system  supervisory  software.  The  representation  of  a wide 
variety  of  computer  system  hardware  is  supported.  Extensive 
support  is  provided  for  modeling  processes  and  process 
interaction.  Limited  support  for  TP  subsystem  modeling  is 
provided.  Ho  special  support  is  provided  for  simulating 
DBMS  components  and  activities. 

ECSS  is  most  applicable  to  the  modeling  of  a DBS  from  a 
general  computer  system  perspective,  where  the  focus  is  on 
hardware,  supervisory  and  application  software,  and  processor 
and  I/O  activity.  ECSS  has  been  used  successfully  to  model 
a wide  variety  of  computer  systems.  I-7hile  it  does  not 
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currently  provide  special  support  for  modeling  certain  DBMS 
and  TP  components  and  activities,  its  internal  structure, 
powerful  base  language,  and  macro  processor  facilitate  the 
extension  of  its  basic  computer  system  modeling  facilities 
to  modeling  DBMS  and  TP  subsystems. 

In  view  of  their  different  orientations,  IPSS  and  ECSS 
have  great  potential  for  use  as  complementary  tools  for  DBS 
modeling  and  performance  evaluation.  As  an  example,  an  IPSS 
model  of  a DBS's  DBMS  subsystem  could  be  used  to  generate 
workload  and  performance  data  for  use  as  inputs  to  an  ECSS 
model  of  the  DBS's  computer  system  environment. 

C.  DIMUI 

DIMUI  supports  the  representation  of  data  base  structure, 
data  base  implementation,  and  data  management  related  tasks. 
Representation  of  computer  system  supervisory  software  is 
limited  to  data  management  related  tasks.  Support  for  the 
representation  of  computer  system  hardware  is  very  limited, 
and  TP  subsystem  modeling  is  not  supported. 

The  usability  and  generality  of  DIMUI 's  approach  to 
modeling  data  base  structure  and  implementation,  data  base 
accessing,  and  data  management  related  tasks  is  difficult  to 
assess  due  to  the  current  lack  of  a modeling  language  and 
adequate  documentation. 
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Very  portable.  ECSS  inploTEntations  exist  for  IBM  360/370  series, 
Honeyiell  600/6000  series,  CDC  6000  series,  euid  ixn\nc  1100  seriei 
ocnixiter  ^stevns. 


STABIUTY/KhUABILITY  BCSS  is  a stable  progran;  product  whose  reliability  has  been  establis^'ied 

by  extensive  use  over  a two-year  period. 
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